tiplicks!

Check that curl is connecting through your proxy

2012-02-10T13:50:00.001-08:00

http_proxy=http://localhost:8082 curl -C - -O -# -v -A 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13' http://www.cotse.com/proxycheck2.htm > index.html

Then open that html file in your browser

Replace windows specials characters like curly quotes and ellipses in MySQL

2012-02-03T12:39:00.000-08:00

UPDATE `table` SET `column` = REPLACE(`column`, 0xE28098, "'");
UPDATE `table` SET `column` = REPLACE(`column`, 0xE28099, "'");
UPDATE `table` SET `column` = REPLACE(`column`, 0xE2809C, '"');
UPDATE `table` SET `column` = REPLACE(`column`, 0xE2809D, '"');
UPDATE `table` SET `column` = REPLACE(`column`, 0xE28093, '-');
UPDATE `table` SET `column` = REPLACE(`column`, 0xE28094, '--');
UPDATE `table` SET `column` = REPLACE(`column`, 0xE280A6, '...');
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(145), "'");
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(146), "'");
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(147), '"');
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(148), '"');
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(150), '-');
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(151), '--');
UPDATE `table` SET `column` = REPLACE(`column`, CHAR(133), '...');

a few ways to force-unmount a disk image in OS X

2012-01-26T22:07:00.000-08:00

Not that you should ever have to do this or anything.

sudo umount -f /Volumes/Yourdisk

sudo diskutil umount force /Volumes/Yourdisk

For this one you need to first get the disk location with the mount or df command:

hdiutil eject -force /dev/disk2sX

mod_rewrite magic! Redirecting "behind the scenes"

2012-01-20T13:52:00.000-08:00

I've posted about this before, but I have found another use for this trick. A client wanted to put dynamic JSP function on one of their sites, but the site in question was a simple apache vhost that was not running the tomcat application server. I didn't want to create a new instance of the application server and basically have to move the site just to add this little function they wanted...So, I built the JSP pages on another server (on a completely different domain) and used this mod_rewrite trick to make it appear to the user that they haven't left the site. Beautiful! You'd put something like this in your .htaccess file:

RewriteEngine On
RewriteBase    /

# first, make sure all http hosts have the www.
RewriteCond %{HTTP_HOST} !^www\.yoursite\.com [NC]
RewriteRule ^(.*)$ http://www.yoursite.com/$1 [L,R=301]

# check for any hits to the specific application page you want to forward to.
# the second rewritecond is very important, otherwise ALL hits will be forwarded
# add additional rewritecond's for each app page you want forwarded
RewriteCond %{HTTP_HOST} ^www\.yoursite\.com [NC]
RewriteCond %{REQUEST_URI} ^/dynamic_catalog [NC]
RewriteRule (.*) http://www.yourapplicationsite.com/%{REQUEST_URI} [L,P]

Fixing perl environment problem on os x 10.7

2012-01-13T13:37:00.000-08:00

When upgrading from 10.6 to 10.7 some of my perl modules seemed to break (namely DBD::mysql). I tried to re-install via cpan and couldn't do it. Couldn't even do a force install.

Fortunately, there are alot of perl mods available through the fink package manager. I ran:

sudo fink install dbd-mysql-pm5123

and it installed the module no problem. Great. I could then execute my perl programs from the command line. Problem is, the path where fink puts the perl mods is not available to cron. So, I had to specify the additional perl library paths in the crontab itself. I added this to the top of my crontab:

PERL5LIB=/sw/lib/perl5/5.12.3/darwin-thread-multi-2level:/sw/lib/perl5/5.12.3:/sw/lib/perl5/darwin-thread-multi-2level:/sw/lib/perl5:/sw/lib/perl5/darwin:$PERL5LIB
LC_ALL=C

Source: Peter's Mac OS X Notes

print standard library paths to your perl modules

2012-01-13T13:18:00.000-08:00

perl -le 'print foreach @INC'

Fix for Postfix mail issue after upgrading from OS X 10.6 to 10.7

2012-01-13T12:36:00.000-08:00

Postfix stops working. It throws errors like:

Jan 13 12:18:52 huggybunny postfix/master[2254]: warning: process /usr/libexec/postfix/smtp pid 2299 exit status 1
Jan 13 12:18:52 huggybunny postfix/master[2254]: warning: /usr/libexec/postfix/smtp: bad command startup -- throttling

I had it set up to replay through GMail. Looks like the /etc/postfix/sasl_password file was deleted during the upgrade. All I had to do was create it again per these instructions, reload postfix and it was good to go.

Empty the Postfix mail queue

2012-01-13T12:01:00.001-08:00

Deletes everything.

sudo postsuper -d ALL

Running Parallels 5 or 6 after upgrading to Mac OS X Lion (10.7)

2012-01-03T10:25:00.000-08:00

Naturally, Parallels doesn't work after upgrading. It will show you an error like "Unable to load the Parallels Driver. Please restart your mac and try again." when you try to start a virtual machine. They are relentless about keeping you on the teat of their upgrades. Just like Intuit.

Anyway, I found a workaround. All I can say is that it worked for me. Don't blame me if it blows up your computer. I am doing this as "root" user rather than sudo-ing. Run these commands and it should start.

chgrp -R wheel "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/";
sudo kextutil "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/prl_hypervisor.kext";
sudo kextutil "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/prl_hid_hook.kext";
sudo kextutil "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/prl_usb_connect.kext";
sudo kextutil "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/prl_netbridge.kext";
sudo kextutil "/Library/Parallels/Parallels Service.app/Contents/Kexts/10.6/prl_vnic.kext";

So, after that, you might (i.e. will probably) need to run this "Parallels Desktop Launcher" script. Perhaps even every time you run parallels (you could just replace the icon in your dock I suppose)

Launcher

When the Mac App store hangs on connection (10.6 or later)

2012-01-03T07:11:00.001-08:00

Close App Store and iTunes completly (blue circle under each should disappear)
Open Terminal (Applications -> Utilities -> Terminal)

Run the following:

mv -f ~/Library/Preferences/com.apple.storeagent.plist ~/Library/Preferences/com.apple.storeagent.old.plist
mv -f ~/Library/Preferences/com.apple.appstore.plist ~/Library/Preferences/com.apple.appstore.old.plist

This will reset a number of preferences about the App Store.
Restart your Mac! - This is key!
Open App Store. you'll need to re-login

Setting a specific proxy for Google Chrome

2011-12-28T06:31:00.000-08:00

Like Safari, Google Chrome uses OS-level proxy settings. But what if you need your browser on a different proxy? Answer: you can pass proxy info to Chrome by opening it on the command line like this:

open -a /Applications/Google\ Chrome.app --args --proxy-server=[host]:[port]

And if you want the convenience of launching from your dock, create a wrapper script and icon using one of these methods (copied from here because it's a flaky link):

Option 1: Use Automator to create an application that in effect launches Chrome with command line arguments.

Start Automator and select to create an Application. Double-click Run Shell Script in the Library/Utilities folder and replace the text content — cat — with the following:

open -a /Applications/Google\ Chrome.app --args --proxy-server=[host]:[port]

Save anywhere you like.

To replace this application's icon, Get Info on your real Google Chrome, click on the icon on the top left, press Cmd-C, Get Info on your Chrome Automator app, click the icon, and press Cmd-V.

Since it's a different application, the Dock will display two Chrome applications when it's running: Chrome, and your Chrome launcher.

Option 2: Edit your application bundle to launch a script instead. This script will start the actual application, adding the command line argument.

Right-click Google Chrome.app and select Show Package Contents. Go to Contents/ and open Info.plist in Property List Editor/Xcode (Apple's developer tools), or a third party plist editor.

Look for the entry CFBundleExecutable or Executable File. Remember its value (e.g. firefox-bin for Firefox). Replace it with parameterized-app.sh.

Open Terminal and enter the following:

touch /Applications/Firefox.app/Contents/MacOS/parameterized-app.sh
open /Applications/Firefox.app/Contents/MacOS/parameterized-app.sh

An editor for the .sh file will open. Set the contents of the file to:

#!/usr/bin/env bash
/Applications/Firefox.app/Contents/MacOS/firefox-bin -ProfileManager

(using the actual executable's name you removed from Info.plist, adding the desired command-line arguments)

Save and close. In Terminal, enter the following:

chmod +x /Applications/Firefox.app/Contents/MacOS/parameterized-app.sh

Now, close Terminal and move your application (which must not be running right now) to a different folder and back again. This will update Launch Services, otherwise your changes will be ignored and irritate you immensely.

Now, when you open your application, it will actually execute the .sh file, which will in turn launch the actual executable file, sending the command line args along.

It will look and behave like you expect it to, but you will need to repeat this whenever you update your application, as this will generally replace the application bundle and all the changes you made.

Shell Script to re-name file extensions

2011-10-28T14:11:00.001-07:00

OLDEXT=${2/#.}
for file in *.jpg ; do mv $file `echo $file | sed 's/\(.*\.\)jpg/\1png/'` ; done

Remove multiple instances of a character (or a pattern) from a URL, then do a 301 redirect, with mod_rewrite

2011-07-18T12:22:00.000-07:00

There was actually some html tags appearing in some of my URLs. This hack strips tags and does a search-engine-friendly redirect.

RewriteCond %{REQUEST_URI} ^(.*)<.*?>(.*)$
RewriteRule ^.*$ %1%2 [E=replacer:%1%2]
RewriteCond %{ENV:replacer} !^$
RewriteCond %{ENV:replacer} !^.*<.*?>.*$
RewriteRule ^.*$ %{ENV:replacer} [R=301,L]

This part matches the tags: "<.*?>". Replace that with your character or pattern.

Check line endings of a file from command line

2011-07-14T17:48:00.000-07:00

type 'od -c [filename]' and look for either \n (indicating LF) or \r \n (indicating CRLF)

Search bash history

2011-07-14T17:38:00.001-07:00

Not sure why I never new this, but hitting ^r in bash will put you into history search mode. Type the beginning of the command, then just keep hitting ^R to go back in history. Helps when you want to find a long command that you entered previously.

grep pattern to match e-mail address

2011-07-01T11:18:00.001-07:00

grep -Eiorh '([[:alnum:]_.]+@[[:alnum:]_]+?\.[[:alpha:].]{2,6})' file.txt

Workaround for Snow Leopard (10.6) issue with osascript command

2011-02-01T14:16:00.000-08:00

If you see this bizarre error when using the osascript command:

2011-02-01 14:11:28.727 osascript[11990:903] Error loading /Library/ScriptingAdditions/Adobe Unit Types.osax/Contents/MacOS/Adobe Unit Types:  dlopen(/Library/ScriptingAdditions/Adobe Unit Types.osax/Contents/MacOS/Adobe Unit Types, 262): no suitable image found.  Did find:
        /Library/ScriptingAdditions/Adobe Unit Types.osax/Contents/MacOS/Adobe Unit Types: no matching architecture in universal wrapper

it apparently has to do with the mixing of 32 and 64-bit architectures. I don't know what the real fix is, but the workaround is to force osascript to use 32-bit like this:

arch -i386 /usr/bin/osascript -e '[your applescript]'

Strip leading zeroes using regex

2010-12-02T12:04:00.000-08:00

Doesn't actually "strip", rather captures the non-laeding-zero number. Works only on a string that only contains numbers, and is compatible with ancient regex versions.

^[0]+([1-9][0-9]{1,})$

NOTE: will NOT match a number that doesn't have leading zeroes

Neat MySQL SUBSTRING Functions

2010-10-09T13:06:00.000-07:00

Chop off the first character of a string that matches a particular regex pattern:

SELECT SKUID, CATEGORY, SUBSTRING(CATEGORY,2) FROM products WHERE CATEGORY RLIKE '^;([0-9;]{1,20});$'

Chop off the last character of a string

SELECT SUBSTRING(CATEGORY,1,LENGTH(CATEGORY)-1) AS CATEGORY FROM products WHERE CATEGORY RLIKE '^([0-9;]{1,20});$';

Extract the domain name (including subdomain) from an URL:

SELECT SUBSTRING_INDEX(SUBSTRING_INDEX(url,'://',-1),'/',1) FROM urls

Recursively delete old directories

2010-10-04T15:53:00.000-07:00

careful with this one!

/usr/bin/find /home/user/oldlogs/ -maxdepth 1 -type d -mtime +90 -exec rm -rf {} \;

Use 'find' to recursively chmod files

2010-09-22T10:48:00.001-07:00

another 'find' quickie...

find /home/user/files/ -name 'myfile.sh' -exec chmod 755 {} \;

Capitalize the first letter of a sentence with MYSQL

2010-09-16T10:32:00.000-07:00

UPDATE `categories` SET category_name = CONCAT(UCASE(SUBSTRING(`category_name`, 1,1)),LOWER(SUBSTRING(`category_name`, 2)))

MySQL function for replacing HTML entities with their actual characters

2010-06-14T11:36:00.000-07:00

For a more comprehensive function containing more special characters see http://forums.mysql.com/read.php?98,246527

Actually, better use that link (above). Blogger is messing with the code below.

Usage:

SELECT HTML_UnEncode(firstname),HTML_UnEncode(lastname) FROM users;

DELIMITER $$

DROP FUNCTION IF EXISTS `sourcedatabase`.`HTML_UnEncode`$$
CREATE DEFINER=`user`@`localhost` FUNCTION `HTML_UnEncode`(x VARCHAR(255)) RETURNS varchar(255) CHARSET latin1
BEGIN

DECLARE TextString VARCHAR(255) ;
SET TextString = x ;

#quotation mark
IF INSTR( x , '"' )
THEN SET TextString = REPLACE(TextString, '"','"') ;
END IF ;

#apostrophe 
IF INSTR( x , ''' )
THEN SET TextString = REPLACE(TextString, ''','"') ;
END IF ;

#ampersand
IF INSTR( x , '&' )
THEN SET TextString = REPLACE(TextString, '&','&') ;
END IF ;

#less-than
IF INSTR( x , '<' )
THEN SET TextString = REPLACE(TextString, '<','<') ;
END IF ;

#greater-than
IF INSTR( x , '>' )
THEN SET TextString = REPLACE(TextString, '>','>') ;
END IF ;

#non-breaking space
IF INSTR( x , ' ' )
THEN SET TextString = REPLACE(TextString, ' ',' ') ;
END IF ;

RETURN TextString ;

END$$

DELIMITER ;

Find duplicate records in MySQL

2010-06-08T09:25:00.001-07:00

SELECT email, 
 COUNT(email) AS NumOccurrences
FROM users
GROUP BY email
HAVING ( COUNT(email) > 1 )

sed one-liner for removing HTML tags from a file

2010-05-20T12:54:00.001-07:00

sed -e 's/<[^>]*>//g' myfile.html